Thermodynamic Construction of an One-Step Replica-Symmetry-Breaking Solution in 

Finite Connectivity Spin Glasses 
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An one-step replica-symmetry-breaking solution for finite connectivity spin-glass models with K 
body interaction is constructed at finite temperature using the replica method and thermodynamic 
constraints. In the absence of external fields, this construction provides a general extension of replica 
symmetric solution at finite replica number to one-step replica-symmetry-breaking solution. It is 
found that this result is formally equivalent to that of the one-step replica-symmetry-breaking cavity 
method. To confirm the validity of the obtained solution, Monte Carlo simulations are performed for 
K = 2 and 3. The thermodynamic quantities of the Monte Carlo results extrapolated to a large-size 
limit are consistent with those estimated by our solution for K = 2 ai all simulated temperatures 
and for K — 3 except near the transition temperature. 

PACS numbers: 64.60.De, 75.50.Lk 



I. INTRODUCTION 

Since the celebrated paper by Edwards and 
Anderson[l|, mean-field theory of spin glass (SG) has 
been extensively investigated. The replica theory^, Q is 
one of the most successful achievement that has revealed 
the nature of the low temperature phase of mean-field 
SG models. Parisi's pioneering work provided the replica 
method with implementation of replica symmetry 
breaking (RSB). Originally, K step RSB (A'RSB) was 
proposed as "a sequence of approximated solutions" to 
the true solution and the full RSB solution was derived 
as a oo limit. This approach has actually proven 

to be exact recently^ for the Sherrington-Kirkpatrick 
(SK) modelQ. Although this introduction of RSB is 
motivated by de Almeida- Thouless (AT) condition^, 
which is the instability of replica symmetric (RS) 
solution with respect to replica couplings, it should be 
noted that AT instability is only one of the possible 
scenario for RSbQ and that the origin of RSB is in 
general model-dependent. In addition, a IRSB solution 
for various mean- field SG models [1, Q is stable with 
respect to further RSB perturbation, and iiTRSB rarely 
appears for K > 2. These facts suggest that there is 
another mechanism to break the replica symmetry and 
it distinguishes IRSB from full RSB (FRSB). 

Recently, the authors have shown 10:] that p-body SK 
model, which is a typical model to exhibit a SG transi- 
tion to IRSB phase, actually has another reason to break 
the replica symmetry above the Gardner temperature @. 
It is the monotonicity condition of the cumulant gener- 
ating function of the free energy 4>{n), whose limiting 
value at n = is the averaged free energy, rather than 
the AT condition that causes RSB nil . The relevance 
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of these conditions is reversed at the Gardner tempera- 
ture, where the transition between IRSB and full RSB 
takes place. Furthermore, it is proved that if the mono- 
tonicity is broken in the absence of external field, which 
ensures the smallest overlap parameter qo = 0, then the 
correct IRSB solution is given by the RS solution at n™, 
which is defined as the monotonicity breaking point, i.e., 
4>'{nm) = 0. This has revealed that the continuation of 
the cumulant generating function 4>{n) to 0(0) is strongly 
restricted by a kind of thermodynamic constraints and 
that it naturally induces the IRSB solution in the case of 
a fully connected mean-field SG model. Regarding n as a 
fictitious inverse temperature, we can resort to the ther- 
modynamics for extracting high-temperature, or replica, 
limit(?i 0) from low-temperature behavior(n ^ 1). 
These facts strongly suggest that IRSB is a consequence 
of the monotonicity breaking and FRSB is that of AT 
stability breaking. 

Finite connectivity SG model has been considered as 
a first non-trivial extension of the mean-field theory, and 
challenged in many literatures. As a straight-forward 
extension from the case of fully connected model, per- 
turbation theories in the region of the large connectiv- 
ity or near the transition ternperature have been stud- 
ied in the rep lica formalism (ill. [T^ . Another replica 
calculation [ij, [ij, [3 ^^^s succeeded to derive an ex- 
act expression of the free energy under a non-trivial 
ansatz called factorized ansatz. The difficulty in these 
works appears in the search for an RSB saddle-point, be- 
cause RSB is defined using the symmetry of a saddle- 
point in the theory. In contrast, the cavity method 
turned out to be an alternative and promising approach 
to study the finite connectivity models within IRSB 
scheme 111 [H [13, [H, [11. The key concept of this 
method is the complexity [20|. logarithm of a number of 
the pure states, which enables one to deeply understand 
the microscopic structure of configuration space. It is 
found that the non-negativity condition of the complex- 
ity is relevant for the IRSB cavity scheme, that provides 
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a general procedure for mean-field type models including 
finite connectivity SG. 

In this paper, we further examine the possibility of 
IRSB scenario suggested in our previous work, which 
might be important for a better understanding of the 
SG theory and also the replica method itself. The model 
discussed is a finite-connectivity Ising SG model with K- 
body interactions. The reason why this model is consid- 
ered as a good example is twofold. First our construction 
of IRSB solution is applicable to the finite-connectivity 
SG model, because RS solution can be explicitly ob- 
tained. Second, we see a direct correspondence between 
the guiding principle of introducing IRSB in the replica 
method and the cavity method [l3l|. 

The organization of this paper is as follows. In Sec. W\\ 
we review our previous work[l3| for complete and de- 
tailed instructions of our scheme, in which a construction 
of a IRSB solution from RS ansatz is explained. Then 
a SG model defined on a sparse random graph is intro- 
duced and the IRSB solution for the model obtained by 
our scheme is presented. We also discuss a relationship 
between our scheme based on the replica theory and the 
cavity method for the model. In Sec lIIIi we compare the 
IRSB solution to the result by MC simulation. Finally 
Sec.|lV]is devoted to our conclusions and discussions. 



{n(j){n))" < O(convexity), and AT stability. The two for- 
mer conditions, monotonicity and convexity, come from 
a thermodynamic restriction if the replica number n is 
regarded as a "temperature" . In particular, they lead to 
the following proposition [lo|: 

if (t)'{nm) = for n,„ > 0, 
then 4){n) = 0(0) for < n < n,n. 

Therefore, if the RS solution is valid for n > n„n the 
limit n is performed by this proposition. Figure [T] 
shows how the function (j) is connected to the origin. It 
is also shown [loj that the solution (ft-Rsi^m) corresponds 
to the IRSB solution for a wide class of models with 
qo = 0, not restricted to the fully connected models. This 
relationship has already been pointed out in a solvable 
model lU. 

The proposition provides us a simple construction of a 
IRSB solution using only the RS solution. We summarize 
our procedure for the IRSB construction as follows: 

1. Calculate the RS solution 0Rs(fi) as a function of 
the finite replica number n. 

2. Find the value rim which satisfies </>pjg(?T-j7i) = 0. 

3. Set 



II. MODEL AND REPLICA ANALYSIS 

A. Preliminary 

In this section, we briefly review our previous work[lol| 
and explain our scheme for the construction of a IRSB 
solution in a general manner. For a given Hamiltonian 
equilibrium statistical mechanics requires to calculate the 
partition function Z — Trexp(— where Tr denotes 
the sum over all possible configurations of the dynamical 
variables and /3 = 1/T is the inverse temperature. In 
the case of disordered system, one may evaluate Z{J) for 
quenched disorder J and take average of logZ(J) over J 
with an appropriate weight. Using the replica method^], 
the averaged free energy [F] is rewritten as a limit of 
eumulant generating function 4>{n) of F{3) as 



</>(0) = (l>Rs{nm)- 



(2) 



\F] = hm <i ^— log[Z"l 

n->ol Nf3n ^ 



lim (t>(n), 



(1) 



where [• • •] denotes the average with respect to the 
quenched disorder. 

In case where n is a real number, to proceed the calcu- 
lation of the right hand side in Eq. ([1]) needs some ansatz. 
A typical one is replica symmetric (RS) ansatz, which is 
considered to be correct only for sufficiently large n. We 
denote the solution based on the RS ansatz as RS solu- 
tion (/>Rs(?T-). Thus, the limit of (j>{n) we are interested in 
becomes nontrivial when we have no alternatives except 
the RS solution. 

In general, however, the function 4>(n) is restricted 
by the following conditions: (t>'{n) < (monotonicity), 



While the right hand side of Eq. ([2]) is analytically 
tractable but doubtful for n ^ 1 because of the RS 
ansatz, the left hand side is equal to the free energy as 
stated in Eq. H]) but analytically intractable. 

One may notice that this procedure is analogous to the 
original saddle-point method, if one identifies the replica 
number with the breaking parameter. We consider this 
correspondence as the reason why we have to maximize 
with respect to the breaking parameter in literatures. It 
should be noted that this procedure can apply to any 
model in which the RS solution is explicitly obtained for 
any real n. Our procedure does not require overlap ma- 
trix or the introduction of breaking parameter. 



B. Model 

Hereafter we deal with a finite-connectivity Ising SG 
model. The Hamiltonian with K-spin interactions on a 
regular random graph with connectivity C is defined as: 

where 

G = |a* = Mi),---,M^)}; 

A.(*)e{l,2,.-.,7V},A*(*)^/x(j)(*7^j)V (4) 
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FIG. 1; A schematic figure of <j>{n) as a function of tlie replica 
number n. Tliis sfiows tfie construction of a IRSB solution 
using monotonicity and convexity condition. The dashed line 
represents RS solution, which breaks the monotonicity condi- 
tion at n = Um- Below rim, becomes a constant function 
down to zero, corresponding to the IRSB solution. 
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We solve Eqs. (|9]) and (|10p for each n numerically and 
obtain the saddle-point functions 7r(a;) and 7r(i). Details 
for the numerical method we use to solve these equations 
are shown in Appendix |^ Inserting the saddle-point 
functions into Eq. ([5]), wc evaluate (/)rs(") a-s a function 
of n. Fig. [2] shows an example of (f>Rs{n) plotted against 
n for K = 3 and C = 4 at T = 0.33, which is well below 
the expected SG transition temperature, « 0.65. As 



Here (7^ = ±1 represents Ising spins on the random graph 
with N sites. The interactions take ±1 with equal 
probability which gives the unit of energy and temper- 
ature. = 0, 1 are quenched variables, satisfying the 
condition X^^egie^-^M ~ ^ -^'-'^ each site i, namely all 
the sites having the same number of the neighbors C. 



C. Solutions for IRSB 



We calculate the cumulant generating function of the 
model described above within the framework of Sec. Ill Al 
Following the calculation [H, [H, H^, (/-(n) under the RS 
ansatz is evaluated as 



(5) 



(6) 
(7) 
(8) 



(9) 



(10) 



shown in the figure, </irs(?t-) violates the monotonicity 
condition at a certain value ^^(r) which is defined by 

Following our scheme mentioned above, this is enough 
to construct a IRSB solution. The IRSB free energy per 
site / is given as / = '/'R,s(ri,„). It would be interesting 
to see the information of finite replica number is used 
to describe the IRSB free energy. This is a consequence 



where 



C 1 ( C 

4>Rs{n) = log(cosh(/3)) - — extr^.^r { — log/i - Clog /a + log/3 

K p pn y A 



K ^ ( K Y 

^1 = W'^'^kT^i^k) ^ <^ l + tanh(/3J^) J|tanh(/3a;fe) ^ 

k=l J^=±l [ k=l ) 

I2 = da;da;7r(a;)7r(.T) {1 + tanh(/ja;) tanh(/3a;)}" , 



» c re c " 

/3 = / n di77r(i^) < n (1 + tanh(/3a;^)) + 11(1" t'dnh{f3x^)) \ . 

7=1 U=l 7=1 J 

Differentiating (/)rs with respect to tt and tt, we have the saddle-point equations 

tt{x) ^ y I W dx^7r(£^) < n (1 + tanh(/3x^)) + H " tanh(/3i^)) I ^ix-^i 
^ 7=1 1 7=1 7=1 J V 7=1 

%{x) = Y I T\ d.Tfc7r(a;fe) - ^ 5\x- -atanh tanh((/3Jp) J]^ tanh(/3a;fe)) 

^1 J fc=i ^ j^=±i V ^ V fe=i / / 
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of the thermodynamic construction, with which the RS 
solution is connected to the physical limit n — s- 0. 

We have evaluated (/)Rs(?^) at < n < 1 for A' = 2 
and K ^ S, which yields temperature dependence of the 
IRSB free energy shown later. For comparison, we also 
evaluate an RS free energy, which is defined as 0rs(O). 
Temperature dependence of Um for some values of C is 
plotted ior K = 2 and 3 in Fig. [31 Wc also show the 
parameter m ior K = 2 and C = 4 in Fig. [31 evalu- 
ated in Ref. [H. They are in good agreement with each 
other. The transition temperature for = 2 is de- 
rived from the condition that the instability condition 
of Tr{x) = 6{x) and then rim, begin to deviate from zero. 
The estimate of is consistent with the known expres- 
sion Tc = l/atanh(C — l)!!^! considering an appropriate 
factor \f\JC. For A' = 3, Tc is determined by an onset 
temperature at which the monotonicity breaking point 
emerges. Then, rim deviates from unity, that is often ob- 
served in some models exhibiting IRSB transition. While 
the analytic expression of for AT = 3 has not known 
yet, the estimate for C = 4 and 8 is consistent with that 
obtained by the cavity method p^. 

Here wc compare our scheme to the established cav- 
ity method, in particular for the finite connectivity Ising 
SG model[ial- The saddle-point equations, Eqs. ([9]) and 
(jlOp . in our scheme arc the same as the recursion equa- 
tion derived as Eqs. (A. 3) and (A. 4) in Ref. [H, when 
the functions tt and tt are identified as the distribution of 
cavity field and cavity bias, respectively. While the pa- 
rameter n is determined by the monotonicity condition 
= 0, the IRSB parameter m in the cavity con- 
text is determined by the non-negativity condition of the 
complexity S: 



I](/(to)) = Pm^(j)'{m) = (11) 

within the formalism of MonassonjlO, H^. This means 
that these two methods are equivalent when the complex- 
ity is a well-defined quantity. 

In the previous works fl^. fioj . it is shown that the 
result of the cavity method corresponds to that of the 
replica method with a factorized ansatz for the finite con- 
nectivity models. Thus, our construction is also equiv- 
alent to the replica theory with the factorized ansatz. 
In the formalism, the replica number n is substituted for 
the breaking parameter m in the expression of free energy 
without taking the limit n 0. Then, the maximization 
of the free energy with respect to the overlap parameter 
q and breaking parameter m is equivalent to the mono- 
tonicity breaking condition in our scheme. This reason- 
ing does not give a correctness proof of the factorized 
ansatz (and also our) solution, but we convince ourselves 
that it reveals the reason why the factorized ansatz gives 
numerically correct solution. 
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FIG. 2: Replica number n dependence of 4>Ks{ri) of a finite- 
connectivity Ising SG for K = ?> and C = 4 at T = 0.33. 
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FIG. 3: (Color online) Temperature dependence of rim for 
K = 2 (top panel) and for K = Z (bottom panel). Temper- 
ature is scaled as T(C) = T^J K/2C. Each mark represents 
rim for connectivity C = 4, 6 and 8. The solid line represents 
rim for _A-body Sherrington-Kirkpatrick model with Gaussian 
interaction. In the top panel, thermodynamic value of IRSB 
parameter for K — 2 and C = 4 evaluated in Ref. [l^ is also 
shown in filled circle. 
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III. VERIFICATION BY NUMERICAL 
SIMULATION 

A. Monte Carlo method 

In the previous section, we obtain the IRSB solution 
for the Ising SG model with i^-body interactions by using 
our scheme. This is the true solution if the AT instability 
or others would not occur above n,„, but it is difficult to 
examine the validity of 0rs('t-). This situation is similar 
to the case of the cavity method. Instead, here we ver- 
ify our IRSB solution by comparing it to Monte Carlo 
(MC) data. We use exchange MC method f27| in order to 
accelerate relaxation time to equilibrium. The number 
of temperatures is fixed to be 30 and the lowest temper- 
ature is down to 0.5 for all the system sizes and K. 
The simulation parameters for K ~ 2 and K ~ 3 arc 
presented in Table [T] and [TTl respectively. Equilibration 
of the MC simulations is confirmed by seeing that the 
observed quantities are stable within range of error by 
doubling MC steps. 

By using the MC simulation we measure the energy 
ej\j(T) per site and calculate the free energy fN(T) per 
site by thermodynamic integration: 



fN{T) 



.,eM{T') 



T dT 
It 



and the entropy SAr(T) per site as 

ejv(T)-/^(T) 



SNiT) = 



T 



(12) 



(13) 



Through the data at discrete temperatures obtained by 
the exchange MC method, the energy as a continuous 
function of T is evaluated by reweighting formula [28j: 



{A{a) 



I MC 



/e(/3o-/3)ff(^)\(''«) 

\^ IMC 



where denotes the MC average at the inverse 

temperature (i. We apply this formula by setting /3o as 
actually simulated temperature and /3 as required one. 
We choose /3o as the nearest temperature to /? from the 
whole set of simulated temperatures. 



B. Results 

We display thermodynamic quantities, energy, free en- 
ergy and entropy, obtained by MC simulations, together 
with the RS and IRSB solutions for /sT = 2 and C = 4 in 
Fig. Hand for K = 3 and C = 4 in Fig.[5l The data show 
that in the case of if = 2, the RS and IRSB solutions are 
close to each other, but the IRSB free energy is always 
greater than the RS one by definition. 

For T > Tc, the correct solution is given by the para- 
magnetic one, which is described by tt{x) = tt{x) = S{x). 
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Nmcs 


A^s 


32 


1 X lO'^ 


4096 


48 
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2048 


64 


4 X 10^ 


1024 


128 


3 X 10"^ 


512 


256 


5 X 10^ 


128 


512 


5 X 10** 


30 



TABLE I: Parameters of simulation in the case of K = 2 and 
C = 4. The total number of Monte Carlo steps 2A^mcs and 
the total number of samples Ns are presented for each size 
N. The first A^mcs are discarded for equilibration and the 
subsequent A''mcs are used in measurement. 
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A'mcs 




30 


1 X 10^ 


4096 


36 


1 X 10^ 


4096 


45 


2 X 10^ 


2048 


60 


4 X 10^ 


1024 


75 


8 X 10^ 


1024 


120 


3 X 10® 


512 


240 


1 X 10** 


128 



TABLE II: Parameters of simulation in the case of K = 3 
and C — 4. The total number of Monte Carlo steps 2A'mcs 
and the total number of samples Ns are presented for each 
size TV. The first Nmcs are discarded for equilibration and 
the subsequent A^mcs are used in measurement. 



For comparison, we also plot a practical solution based 
on frozen ansatzp9|. in which the paramagnetic solution 
is used at T > Tg and the entropy is kept to zero at 
T < Tg. Here Tg is defined as the temperature at which 
the entropy given by the paramagnetic solution is zero. 
This ansatz leads to the results that the free energy as 
(14) well as the energy is independent of T below Tg. The 
frozen ansatz is interpreted as a paramagnetic solution on 
which the monotonicity condition as a function of tem- 
perature is imposed. Although the true free energy must 
be a monotonically decreasing function of temperature in 
a standard thermodynamic sense, it might not be a suffi- 
cient condition. In fact, MC data and the IRSB solution 
are far from the frozen-ansatz solution. In particular, 
they show non-zero value of the entropy at finite temper- 
atures as shown in the bottom of Fig. [51 which is quite 
different from that of the frozen ansatz. 

For K = 3, we do not plot the RS solution because 
we cannot find it at low temperatures near n = except 
for the paramagnetic one. This suggests that the IRSB 
scheme works even if the RS solution does not exist near 
n = 0, though we cannot rule out the possibility that 
our algorithm for evaluating tt is unstable to find the RS 
solution. 

To sec thermodynamic properties, we extrapolate our 
MC data with finite sizes to the thermodynamic limit 
N oo. Because finite-size correction terms and its 
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FIG. 4: (Color online) Temperature dependence of energy(top 
panel), free energy(middle panel) and entropy(bottom panel) 
for a finite connectivity Ising SG with K = 2 and C — 4. 
MC results are shown by filled marks for = 64, 128, 256 
and 512 from the top. Open squares and open circles are 
the results of the IRSB solution and the RS one, respectively. 
The paramagnetic solution is presented by the dotted line and 
the frozen ansatz is solid line. 

exponent are a priori unknown in SG models, an extrap- 
olation method itself should be investigated. We assume 
that the leading finite-size correction terms for the en- 
ergy, free energy and entropy are expressed as 

eAr = eoo + ae xiV"", (15) 



FIG. 5: (Color online) Temperature dependence of energy(top 
panel), free energy(middle panel) and entropy (bottom panel) 
for a finite-connectivity Ising SG with K = 3 and C = 4. MC 
results are shown by filled marks for A'^ = 30, 60, 120 and 240 
from the top. Details of the lines are the same as those of 
Fig. H 

/w^/oo + fl/ xTV-", (16) 
SN ^ Soo + as X N"'^, (17) 

where Coo, foe and Sqo are the thermodynamic limit of 
the respective quantities, and the correction exponent uj 
is assumed to be independent of the quantities. 

As shown in the previous workjsoj. the ground-state 
energy of the Ising SG model for K ~ 2 defined on a 
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FIG. 6: (Color online) Energy, free energy and entropy as 
a function of l/N^^'^ for a finite-connectivity Ising SG with 
iC = 2 and C = 4 at T = 0.5. The filled squares are MC 
results, filled triangle is IRSB solution, and filled circle is RS 
solution. In solid line, the least square fitting of MC results 
assuming the exponent of the leading finite-size correction ui 
is 2/3 is presented. 



FIG. 7: (Color online) Energy, free energy and entropy as a 
function of for a finite-connectivity Ising SG with K — 3 
and C = 4 at T = 0.2. The points and solid line are the same 
as in Figs. |6] Short-dashed and long-dashed lines represent 
the least-squares fits for the form including the leading term 
of 1/N and up to the next leading terms, respectively. 



regular random graph is scaled with uj = 2/3. Thus, we 
assume that the exponent 2/3 holds for if = 2 at finite 
temperatures and is independent of physical quantities. 
Figs. [S] show the thermodynamic quantities as a function 
of for if = 2 at T = 0.5, which is the lowest ob- 

served temperature. The data are fitted well with the 



assumption w = 2/3 as shown in the figure. The ex- 
trapolated values by the best fit and the results by the 
IRSB and the RS solutions are shown in Table Hill The 
thermodynamic values by MC results agree with those by 
the IRSB solution rather than the RS one. The energy 
extrapolated in a wide range of temperature is displayed 
in Fig. [5] This also suggests that the IRSB solution is 
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-1.4675(2) 


-1.4758(2) 


/oo 


-1.4922(4) 


-1.4937(1) 


-1.4965(1) 




0.0501(9) 


0.0522(2) 


0.04128(2) 



TABLE III: Thermodynamic limit of the energy, free energy 
and entropy of a finite-connectivity Ising SG for K = 2 and 
C = 4 at T = 0.5. IRSB and RS represent those estimated 
from the IRSB solution and the RS one, respectively. MC 
means the extrapolated values from finite-size MC data by 
assuming a power law of the leading correction with the ex- 
ponent LJ — 2/3. 





MC 


IRSB 


frozen ansatz 




-1.217(1) 


-1.2176(1) 


-1.2221 


/oo 


-1.2180(8) 


-1.2188(1) 


-1.2221 




0.005(2) 


0.0058(5) 






TABLE IV: Thermodynamic limit of the energy, free energy 
and entropy of a finite-connectivity Ising SG for K = 3 and 
C = 4 at T = 0.2. IRSB and frozen ansatz represent those 
estimated from the IRSB solution and the frozen-ansatz one. 
MC means the extrapolated values from finite-size MC data 



by assuming a form oi xn = Xo 
X = e, f or s. 



+ aiA^"^ -I- a2N~, where 
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FIG. 9: (Color online) Temperature dependence of the en- 
ergy for a finite-connectivity Ising SG for K = 3 and C — 4. 
The filled squares and cross marks are the extrapolated value 
from MC data with the extrapolation form including the lead- 
ing correction term and up to the next correction terms, re- 
spectively. The IRSB, frozen and paramagnetic solutions are 
represented by solid, long-dashed and short-dashed lines, re- 
spectively. Lon g-sh ort-dashed line is the result of the cavity 
method in Ref. Ilg . The iso-complexity energy obtained in 
Ref. [l^ is also shown by dotted line. The inset is an enlarged 
view at low temperatures. 



consistent with numerical results. 

We turn to the case oi K = 3, where the value of 
Lu is not known even at zero temperature. Although a 
naive way to suppress higher order corrections is to study 
the system for large sizes and/or at lower temperatures 
apart from critical temperature, it has not been feasible 
to perform the MC simulation below T = 0.5 ~ O.TTc for 
N > 240 in moderate CPU time because of extremely 
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T 

FIG. 8: (Color online) Temperature dependence of the energy 
for a finite-connectivity Ising SG for K = 2 and C = 4. The 
extrapolated value from MC data is marked by filled square. 
The IRSB, RS and paramagnetic solutions are represented by 
solid, long-dashed and short-dashed lines, respectively. The 
inset is an enlarged view at low temperatures. 



slow relaxation especially in the case oi K = ?>. This is 
contrast to if = 2 model. However, for relatively smaller 
systems, the distribution function of the energy is found 
to be almost a delta function with the weight at the low- 
est energy. This implies that vthe distribution depends 
weakly only on temperature T below 0.5. This fact en- 
ables us to obtain the energy at temperatures down to 
T 0.2 - O.STc using the reweighting method[2i|. We 
evaluate the correction exponent u) for the energy by the 
least-squares estimation at T = 0.2 and 0.5 with a form 
of Eq. (fT5|) . The estimate of ui is not compatible with 
= 2/3 used in the case oi K = 2, and is rather close 
to w = 1. This tendency is enhanced by omitting the 
smallest size = 30 from the analysis. These findings 
suggest that w ~ 1 and higher order corrections arc not 
negligible. 

Therefore, we extrapolate the MC result for A' = 3 by 
assuming the forms of Eqs. p6p and ([T7]) for ui ~ 1 

with the next leading correction term 1/N'^. The data 
for = 30 are omitted from the extrapolation analysis. 
Figures [7] shows the result of the thermodynamic quanti- 
ties for K = 3 and C = 4 at T = 0.2. The extrapolated 
values, presented in Table IIVI are consistent with those 
of the IRSB solution by taking into account the next 
leading correction term. 

We also show the thermodynamic value of the energy 
for AT = 3 as a function of T in Fig. [9] The extrapolated 
values by the form including the next leading correction 
term are consistent with those by the paramagnetic so- 
lution at T > 0.9 and those by the IRSB solution at 
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low temperatures, though a systematic deviation still re- 
mains around because of the critical fluctuation. As 
shown in the inset of Fig. [9l the agreement between the 
extrapolated value and the value of IRSB solution is held 
at very low temperatures and the limiting value of energy 
at zero temperature coincides with that obtained by zero- 
temperature calculations mi, m, [13 ■ For the case of 
K = 3, the result of the cavity method is also shown in 
Fig. [9|l6|. Analytic results are in good agreement with 
the MC data at low temperatures. These support the 
validity of the scheme also for K ^ 2,. 

Before closing this section, we would like to men- 
tion MC algorithm for studying SG models. In recent 
works [l6l[34|. it is claimed that in annealing simulations 
a slow annealing limit of the energy often leads to the iso- 
complexity energy, significantly above the static equilib- 
rium energy in glassy systems. This has been confirmed 
for = 3 by an annealing simulation (l6|. In contrast, as 
shown in Fig. [9l the energy extrapolated to the infinite- 
volume limit in our exchange MC results is well lower 
than the iso-complexity energy and is compatible with 
that of the IRSB solution at low temperatures. This 
suggests that the exchange MC is suitable for equilibra- 
tion of the SG system even when the system have the 
iso-complexity energy separated from the static one. 



IV. SUMMARY AND DISCUSSION 

We have studied a construction of a IRSB solution for 
quench disordered systems. Our construction is based on 
thermodynamic conditions for the cumulant generating 
function 4>(n) of free energy, which are derived as a nec- 
essary condition in the replica analysis. The only require- 
ment for our construction is to obtain the replica sym- 
metric solution for 4'{n) as a function of n. This is a quite 
general scheme which may provide an unified way to give 
a correct solution for IRSB systems. In fact, our scheme 
reproduces the well-known IRSB solution for fully con- 
nected mean-field SG models such as p-spin 

model[3 

and Potts glass model [3^. As a non-trivial example we 
have applied our scheme to study a IRSB solution for 
finite-connectivity Ising SG models with i^-spin interac- 
tions. The thermodynamic quantities are explicitly eval- 
uated from numerically obtained RS solution with finite 
replica number n using our scheme. 

The saddle-point equations to be solved in our scheme 
are found to be equivalent to recursion equations of the 
cavity-field distributions in the IRSB cavity formalism 
for this model. In a sense, our scheme based on the 
replica theory can be regarded as a reinterprctation of 
the IRSB cavity method. While the cavity method can 
predict the microscopic detail of a model through com- 
plexity, which is an interesting quantity in glassy physics, 
one cannot obtain such a quantity with our scheme at 
present. This would be discussed as a remaining is- 
sue. In contrast, we can construct the IRSB theory ir- 
respective of details of the model, even non-mean-field 



model in principle, because our scheme does not rely on 
the microscopic details, or complexity. Since the pure 
state in finite dimensions is difficult to formulate in a 
tractable manner, this complexity-independent formal- 
ism of IRSB may be useful to investigate nature of RSB 
in finite dimensions [36|. Because the replica method it- 
self is originally independent of calculus of spin variables, 
this theoretical flexibility would give another perspective 
if RSB is formulated within macroscopic level. Therefore, 
we consider that the cavity method and our method are 
complementary in order to understand the nature of SG. 
The correspondence of their results in this model has a 
significance because they should provide the same result 
in the intersection of their validity range. 

Unfortunately, the validity of our IRSB solution could 
not be established within the scheme because of the 
lack of AT analysis. Some AT analyses for finite- 
connectivity models are recently proposed in the previ- 
ous works [H, Ull, [13] ■ They are to be resolved for our 
model and compared with each other in future study. To 
confirm the validity of our scheme in the present work, 
equilibrium MC simulations with the help of extended en- 
semble method have been performed for the model with 
K = 2 and 3. It is shown that for K = 2, the resulting 
thermodynamic quantities by our scheme are in agree- 
ment with those obtained by MC simulation within sta- 
tistical error. For = 3, assuming that the size depen- 
dence of the thermodynamic quantities is expressed as a 
polynomial of 7V~^, we have concluded that our IRSB 
solution is also consistent with those extracted from the 
finite-size MC data. If we have the correction exponent 
Lo a priori, we can promote the accuracy of our extrapo- 
lation. Optimization techniques for ground-state search 
would be a promising approach for estimating the value 
of w for if = 3. 

As a by-product of the MC simulations, it is found 
that a coefficient of the first finite-size-correction term is 
positive. Namely, the finite-size data reach their ther- 
modynamic value from above with increasing the system 
size. This suggests that fluctuations on the positive side 
of the thermodynamic value is relevant for the finite-size 
corrections in these models. On the other hand, the prob- 
ability of large deviations which can be calculated using 
the replica theory with n > is the negative side for 
the free energy in the fully connected SK modeljll]. The 
replica theory with n < for the large deviations is re- 
quired to evaluate the finite-size correction. 

The key ingredient in our scheme for constructing the 
IRSB solution is the thermodynamic constraints as a 
necessary condition in the replica theory. This is com- 
pared to the fact that the standard replica method intro- 
duces RSB scheme through the symmetry of the saddle 
point. Another thermodynamic constraint, thermody- 
namic homogeneity, has been discussed in Ref. [1^. One 
might stress the importance of such a thermodynami- 
cal approach which leads to an universal framework irre- 
spective of microscopic models. Actually, our scheme is 
rather general and quite simple. It only needs the func- 
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X 

FIG. 10: A saddle-point function 7r(.T) for K = 3, C = 6,T - 
0.75 and n = 0.713. 



and (1101) . We use an iteration method, introduced in 
Ref. |40. The saddle-point functions tt{x) and 7r(a;) are 
approximated by a large M number of samples from tt 
and 7T. The algorithm for evaluating the function t:{x) 
and 7r(i) is as follows: 



1. Give an appropriate array hi{i 
initial condition to tt. 



1, 2, • • • M) as an 



2. Sample K — 1 independent values of {xk} {k = 
l,---,K — 1) from 7r(x) by generating a ran- 
dom integer / uniformly distributed from 1 to 
M and setting x^ = hi, and evaluate x = 

1 f '''' \ 

— atanh I tanh/3 tanh(/3xfc) j . 

^ V k=i J 



tion (/)Rs(f^) which is constructed in the way of replica 
symmetric analysis. Thus, we can avoid the arbitrariness 
to introduce breaking parameter in the replica theory. 
One can find further applications in related statistical- 
mechanical systems in which the RS solution can be con- 
structed. 



3. Put the sign chosen with probability 1/2 to x and 
get hi = X, which corresponds to a sample of tt. 

4. Repeat the steps 2 and 3 M times and obtain the 
M samples of tt, {hi}. 
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APPENDIX A: ALGORITHM FOR EVALUATING 

TV AND TT 

In this appendix, we explain details of the numerical 
method we used to solve the saddle-point equations © 



5. Sample C — 1 independent values of {xj} (7 = 
1,---,C — l)bya procedure similar to that of step 

c-i 

2 and evaluate x = x~f. 

7=1 

6. Accept X obtained in step 5 with probability 

^ (c-i c-i 
^^c^ m (1 + tanh(/3x^)) +[1(1- tanh(/3f^)) 

1 7=1 7=1 
and accumulate a new set of {hi} of tt till the 
number reaches M. 

7. Return to 2. 



We iterate the above procedures until convergence. 
The number of the samples is set typically as M = 10^ 
in our calculation. A typical form of Tr{x) is displayed in 
Fig.M 
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